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Abstract 

Networks  of  interacting  components  permeate  science  and  engineering.  The  common  paradigm 
is  the  ability  of  lower-level  components  to  generate  higher-level  sophistication  without  central¬ 
ized  intelligence.  Increased  understanding  of  the  interplay  between  network  structure  and  the 
resulting  dynamics  is  now  enabling  researchers  to  design  emergent  behaviors  for  engineering 
applications,  such  as  cooperative  robotics  and  synthetic  biology. 

In  this  project  we  developed  an  input-output  approach  to  predict  and  engineer  collective 
behavior  in  networks.  This  approach  overcomes  the  complexity  of  the  large-scale,  nonlinear 
dynamical  model  by  dividing  the  analysis  and  design  tasks  into  two  layers:  At  the  network 
layer,  we  represent  the  nodes  with  appropriate  input-output  properties  as  abstractions  of  their 
detailed  models  and  exploit  these  properties  in  conjunction  with  the  interconnection  structure  to 
ascertain  desirable  behaviors.  At  the  node  layer,  we  verify  or  assign  the  input-output  properties 
without  relying  on  knowledge  of  global  network  properties. 

Automated  methods  for  verification  of  complex,  adaptive,  nonlinear  systems  is  a  key  enabler 
for  the  Air  Force  mission.  The  analysis  and  design  tools  resulting  from  this  project  were  applied 
to  multi-agent  systems,  biological  networks,  and  to  traffic  networks.  Conceptual  unification  of 
ideas  from  diverse  types  of  networks  is  of  fundamental  importance  for  network-centric  operations 
which  call  for  core  concepts  and  widely  applicable  tools. 


1  Results 

1.1  Stability  Certification  for  Networks  from  Input-Output  Properties 

This  project  developed  an  input-output  approach  to  networks  that  is  uniquely  capable  of  overcoming 
the  complexity  of  large-scale  dynamical  models.  This  approach  abstracts  input-output  properties 
of  the  components,  rather  than  dealing  with  detailed  dynamical  models,  and  exploits  the  coupling 
structure  to  predict  and  engineer  collective  behavior. 


I 


One  of  our  key  contributions  was  to  exhibit  special  interconnection  structures  amenable  to  this 
approach  in  diverse  types  of  networks.  In  [1],  we  applied  this  approach  to  cooperative  control 
problems  and  demonstrated  its  design  flexibility.  Unlike  the  point  mass  models  commonly  used 
in  the  literature,  we  use  a  passivity  property  inherent  in  rigid  body  models  for  satellites,  robots, 
marine  vehicles,  etc.  The  research  monograph  [1],  published  by  Springer,  presents  new  robust  and 
adaptive  designs  demonstrating  the  power  and  flexibility  of  the  passivity  approach  in  cooperative 
control  design.  We  further  extended  these  results  to  solve  the  problem  of  decentralized  attitude 
synchronization  of  rigid  bodies  [A7] ,  and  to  design  distributed  control  strategies  for  a  team  of  mobile 
agents  that  allows  for  size-scaling  of  a  formation  while  maintaining  the  formation  shape  [A8].  We 
have  solved  this  problem  without  relying  on  direct  communication  between  the  agents,  using  only 
relative  distance  information  to  propagate  cues  about  the  desired  size  from  a  leader. 

We  then  addressed  several  practically  important  problems  to  expand  the  applicability  of  the 
input-output  approach:  Because  the  network  equilibrium  depends  on  the  interconnection,  we  pro¬ 
posed  a  notion  of  equilibrium-independent  dissipativity  and  provided  analytical  and  numerical  tools 
for  its  verification  [A3].  With  this  notion,  the  components  of  the  network  are  now  modular  and 
stability  is  established  without  explicit  knowledge  of  the  network  equilibrium.  This  result  is  par¬ 
ticularly  important  for  biochemical  reaction  networks  where  the  steady-state  depends  on  highly 
uncertain  system  parameters.  Using  equilibrium-independent  passivity  and  graph-theoretic  con¬ 
cepts,  we  developed  a  stability  criterion  for  a  class  of  reaction  networks  that  exhibit  intertwined 
feedback  loops  as  in  metabolic  networks  and  oscillator  circuits  [A4]. 

Stochastic  models,  which  are  particularly  important  for  biochemical  reactions,  are  studied  with 
new  stochastic  passivity  notions  in  [A9].  In  [AlO],  we  defined  a  “frequency  roll-off’  property  that 
captures  time-scale  information  about  the  components  and  combined  this  property  with  passivity 
to  address  time  delays  in  the  network  links.  This  result  provides  a  means  to  smoothly  interpolate 
among  stability  conditions  provided  by  passivity  analysis  and  the  small-gain  theorem,  as  the  bound 
on  the  time  delay  varies  from  zero  to  infinity. 

1.2  Synchronization  and  Spatial  Pattern  Formation 

In  collaboration  with  colleagues  in  synthetic  biology,  we  started  investigating  how  critical  processes 
in  natural  multicellular  organisms  can  be  reestablished  in  a  bacterial  medium  to  enable  synthetic 
multicellular  systems.  A  problem  of  particular  interest  is  spatial  gene  expression  patterns  that 
allow  distinct  cell  types  to  emerge  in  the  early  development  of  natural  organisms. 

Using  our  analysis  and  design  tools  described  above,  we  proposed  a  novel  gene  network  that 
spontaneously  generates  such  patterns  with  the  help  of  a  diffusible  molecule  establishing  cell-to-cell 
communication  [A5].  The  architecture  of  this  network  is  grounded  in  feedback  control  principles 
and  the  resulting  pattern  formation  is  interpreted  as  a  nonminimum  phase  phenomenon  in  [A23]. 
This  network  incorporates  an  oscillator  circuit  combined  with  a  feedback  loop  that  quenches  the 
oscillations  and  contains  a  diffusible  molecule.  As  demonstrated  mathematically  in  [A5],  diffusion  of 
this  molecule  allows  spatial  modes  with  high  wave  numbers  to  grow  into  a  spatio-temporal  pattern. 
The  proposed  architecture  is  amenable  to  synthetic  implementation  since  oscillator  circuits  already 
exist.  The  publication  [A5]  has  been  received  well  by  the  synthetic  biology  community,  and  we  are 
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now  implementing  this  gene  network  in  vivo  [A21]. 

While  investigating  the  mathematical  principles  of  diffusion-driven  pattern  formation,  we  also 
developed  new  insights  about  the  converse  problem  of  synchronization.  Synchronization  is  essen¬ 
tial  for  several  physiological  processes,  such  as  circadian  rhythms,  insulin  secretion,  cardiac  func¬ 
tion,  and  for  engineering  systems,  such  as  multi-machine  power  systems  and  multi-agent  systems. 
In  [A2]  and  [A12],  we  studied  reaction-diffusion  PDE  models  for  spatially  distributed  processes 
and  presented  analytical  and  numerical  tests  that  guarantee  spatially  homogeneous  solutions.  As 
demonstrated  in  these  references,  the  new  tests  provide  dramatic  improvements  over  existing  spatial 
homogeneity  criteria  in  the  mathematical  biology  literature. 

By  abstracting  the  coupling  structure  generated  by  diffusion,  we  next  addressed  a  broad  class  of 
networks  where  the  feedback  to  each  node  is  a  local  sum  of  differentials  with  respect  to  neighbors. 
This  form  of  coupling  arises  in  coordination  of  multi-agent  systems,  electromechanical  coupling  of 
synchronous  machines,  and  macroscopic  models  of  reaction-diffusion  systems.  In  [A6],  we  studied 
networks  with  this  coupling  structure  and  asked  how  the  coupling  weights  should  be  assigned  to 
enhance  synchronization  properties.  We  then  developed  convex  optimization  algorithms  that  solve 
this  problem  with  the  help  of  tools  from  spectral  graph  theory. 

Our  synchronization  criteria  rely  on  sufficient  connectivity,  as  measured  by  the  second  smallest 
eigenvalue  A2  of  the  Laplacian  matrix  describing  the  interconnection  graph.  Suppose  now  that  the 
connectivity  is  initially  too  weak  to  afford  synchrony.  Can  the  the  link  weights  be  updated  locally 
to  achieve  synchronization?  We  addressed  this  problem  in  [A  15]  and  developed  an  adaptive  scheme 
that  increases  the  weight  links  according  to  the  synchronization  error  between  the  nodes  connected 
by  each  link. 

In  a  separate  line  of  work,  we  investigated  pattern  formation  enabled  by  cell-to-cell  contact 
rather  than  by  diffusion.  We  developed  a  broadly  applicable  dynamical  model  for  cellular  inter¬ 
actions  and  revealed  the  key  system  properties  that  enable  spatial  patterns  to  emerge  [All].  We 
then  used  graph  partitioning  concepts  to  predict  what  type  of  patterns  emerge  for  each  type  of 
interconnection  graph  [A13]. 

1.3  Further  Results  and  Conclusions 

Encouraged  by  the  results  summarized  above,  we  started  broadening  the  scope  of  our  research 
on  networked  systems.  In  [A17],  we  extended  our  input-output  approach  to  “safety”  verification 
where  the  goal  is  to  ensure  that  no  trajectory  enters  an  undesirable  region  in  the  state-space. 
We  derived  convex  programs  to  search  for  a  weighted  sum  of  storage  functions,  each  associated 
with  an  input-output  property,  such  that  a  sublevel  set  excluding  the  unsafe  set  exists.  A  related 
task  is  to  design  switching  rules  between  the  discrete  modes  of  a  hybrid  system  to  achieve  a  safety 
specification  that  cannot  be  met  within  a  single  mode.  We  presented  preliminary  results  for  this  task 
in  [A22]  and  applied  them  to  multi-agent  surveillance  problems.  We  further  started  investigating 
the  applicability  of  our  design  and  analysis  tools  to  traffic  networks.  Preliminary  results  in  this 
direction  are  presented  in  [A14]  and  [A16]. 

In  summary,  major  contributions  were  made  in  this  project  to  enable  efficient  analysis  and  syn¬ 
thesis  of  networked  dynamical  systems.  The  results  were  applied  to  multi-agent  systems,  biological 
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networks,  and  to  traffic  networks.  Conceptual  unification  of  ideas  from  diverse  types  of  networks  is 
of  fundamental  importance  for  network-centric  operations  which  call  for  core  concepts  and  widely 
applicable  tools.  The  Dynamics  and  Control  Program  at  the  Air  Force  Office  of  Scientific  Re¬ 
search  has  been  instrumental  in  enabling  major  advances  in  the  field,  and  we  greatly  appreciate 
the  support  received  for  this  project. 
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